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(57)Abstract: 

PURPOSE: To dynamically perform optimum data 
arrangement for decentralizing a load, to shorten the 
transfer time of data, and to perform the transfer 
simultaneously with the calculation by dynamically 
rearranging an object matrix of LU decomposition, 
decentralized and arranged on respective processors, 
into arrangement by parallel transfer at a block level 
where column vectors are bundled. 
CONSTITUTION: The data rearrangement processing 
means 2 of the memory decentralized type parallel 
computer 1 decentralizes and rearrange blocks of 
bundles of column vectors to the respective processors 
(PE). The data transfer required for the arrangement is 
performed in parallel and then speeded up. An LU 
decomposition processing means 3 transfers the time 
data for calculating a matrix product halfway in the LU 
decomposition of the blocks to the respective PEs. The 
time data are divided and transferred, and each PE 
performs calculation for the divided data; and this 
processing is repeated to perform the entire calculation. A forward/backward substitution 
processing means 4 rearranges the matrix into arrangement divided in a row vector direction 
and performs forward/backward substitution. 
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= mi n ($n, #pe— $n) <t"^~So mi n(4. ix 
/JMI*»SBflrC&«. 

[0045] X-r^/^S 2 3|CfcL>"C, $t®(7>^P-tr 
***&c i S9-^fflawi ICIEST So s = 



4#IB¥7-2 7 1 7 6 0 



mod (p+j— 2, #po) +1, d=mod (p + 
$t + j-2, # P e) + i£L, ^n-fr^its^P,^ 
p-tz^-9-dlcj =1, •» $ t 00$ tfl^ttnicCatf 

[O 0 4 6] XtV^S 2 4lCfcLNT. $ o = $ e + 1 
X-r^^S 2 SICfclNT, $n>$ t 
£*IJ£L. $ ntf$ t cfcy^^lt+ilfX^f^^S 2 2^ 
MU. $"n#$ t J:tJ/]>*ltftttX-r ^^S2 "6U5M"" 
(B10) o 

[0 0 4 7] 2 6IC&IVC. c t = 1 

Z>o x-r^y^s 2 7|zfctNT, ct==i*cfcWi:5 
frSWffi-T*. c t ==1 -efeftiix^^s 2 9^m 
H % c t == 1 Trtelttilix-xy^s 2 8 0*&JI£fT 
5 o 

[004 8] 7s7-VJS 2 8ICfclxT, ^31^-5)^^^ 
3 3CDffiS0>iflT^1toT. Z/P-ir^-tfplC-DUT 
Ci (i= c t) $:T—$£LT r ?—<7&&Wl 

[0049] ^^S29l:fcUt, ZfU-byVifr 
b^Pir^^mod (I. # P o) + 1 Ic-x— £ £f££ 
■T^ (W1 ^bW2A061) o Xf7^S3 0Wh 

r. ga&&. ^p-tr^-g-izfc^c i <7>-x— * -csjie-f 

[0050] X'ry^S 3 1 feasor, c t > 1 "Cfc£ 

comm^m?*. c t >i •e^it+ti^x-x^-^s 3 z<D$k 

[0051] Xf7?S32lCfcUt, Xf-^S29 
(W1 J^*W2'MD&3I) <D*£7£f#O e X^y 
3?S3 3f=£Lvc. ct = ct+Uf§, ^Pt'^ 
pfCOl^Ttf);*, C i ( i = c t ) £^—2 t Lt9- 
^^W2-vti2|-r^ 0 

[OO 5 2] X-r^^S 3 4lZfc^r. c t == n "Crfe 
^>^if-5^**0^-r^ e c t = = n TrfcfttfXi^^S 

3 eo>mm^mfr, c t ==nr^it*viix j r^^ , s3 

5<7>j&S£fr5o 

[0 0 5 3] Xf7^S3 5l:fcUt, ^P-tr i 
t>^P-b^itmo d (I. #pe) + 1IZ^r-*£&i£ 
-f<5> (W2*>bW1 o Xf 7^S3 6l3feLN 

T. r7-^®itW2<D-x--^^oT^'r^^J(DM 

[OO 5 4] Xt^^S 3 7lz£l\T. c t = c t +1 
t-T-So Xir^^S 3 8fCj3t^T. c t >n-efc&fr£f 
5A^|l3St^ 0 ct>nt'fem^i*gTL, ct 
> n -CfclttlhfXT 1 -V ^S27 CDflJS^M&o 

[0055] ff5Uco^fq*^^ot>r^iS](D^$ 

tftr^o fc«U $L&){tk'<* hJUffc(0A^>X£# 

7L*>t. m^ta^O h;uST^Pt/^*i^fc^^ct 



[0 0 5 6] Ct^a^f*. *7*lJC^{*£ 2 
-e, #P EirSslLfcig^, -LOG 2 (#pe) <Mt 
— ?<D&&ftmtffrfrZ><DK$il,X. ~1- (LOG 2 

(#pe/n) ) /n(D^- *tfcy#p efttf*£l> 

[0 0 5 7] 

C3T «a5t^^it«A£^Jlcft5±t:CD^ ~ 
[005 8] mile. LU^S^fT^ir^lC^SlCjfvf 

[0 0 5 9] t^, LU#S£*t? t#f~l*. 01 
1 (A) (Dfj&lAOtkolZ, V)\,&&PE.\Zft%L 

-T7#«*3I=. 011 (B) ©frWBflDJ^MMI:* 

[0 0 6 0] z<Dm&£3km\z'n5t-&>\z, ft&lZ&p 
Elz»*lB«**i**J|i-eBi 2l=«*-J;5i::#HL 
t, 

A= (ajj) [1=1. — . #pe, j=1, # 
p e] 

t?Z> 0 ftfc. #p eli^P-b^^ST-fey. 012fi 
^P-fe^-9-a#p e^5tfc^^LtlN|)p 
[0 06 1] fr"^ K^*S-PE|Cf5y^ltfcfT?JjA 
fc. Hli:***©!!*]**^* hJUT-fOyttlffc^JB 

[0062] lil&CDcfc 5 13. 02 lC^-r*^!S0«(O> ^ 
1 OOS^i: 1 •OQS^&^tfpTfifc-efe&o 0 1 3 

ic. 01 i \z^i-^mA^^^\B^<Dm^(Dmmya 

[0 0 6 3] 01 SCDX^^S 4 1 iCfc^T. *^P 

-bv-g- (i -# P o) -e. k=^p-b^-g-§^-. j = 

k, #ct = 1 t+Zo X^r^^S 4 2lCfclN-C. *?>J 
lC#^P-b ^-g-tr B jk= A jk(D^-$ <7>^gg^$^T 

[0064] X-x^y^S 4 3lCfclNT, k=mod 
(k, #p©) +1. #ct=#ct + Ut§ 9 
v:/S 4 4lZfcl*T. #ct>#p6t'fc53!)^5)(l^ 
m^-tho #ct>#peTfe*lMIf«7U #c 
t >#p e-efcltttteX^r^S 4 2CD5&S^M^)o 



(7) ftffi^ 7-27 1 7 60 



[0 0 6 5] fr^jBfi, H 1 4\Z-m-?&5\^, ^T^RI" 

<t-*-£ 0 LUx = d$S<(b$, Ly = d^. Ux 
= y£Jilc«<o dtL^afeWlcfrdfrAfz, #PEI= 
d. x. y^lfilTftOc Ux = yl^^ttTOl 

[0 0 6 6] P E 1 "CL-H x y 1 =d 1 £»<o 

P E 1 0)y 1 $#^P-tr^-9-±0)^ay 0>y 1 0)35#^ 
2 0>r\im'<*->V&L&L-f&o (#pe-1) ®0)PE 
Trailed i=d i-Ljixy 1 £fr5 ( i = 2. 
#p e) o 

[0 0 6 7] f^fillC, PE2tL22Xy1=d1Jg 
< 0 PE2(«y 2^S-^Pt^1t±(D$»y^y 2039 
^2CDrtl^/<^->-C^3l|-r^o (#pe-2) @0) 
P E Trailed i =d i -Lj2* y 2 £fr5 ( i =3. 
# p e ) o 

[0 0 6 8] p]t$|C, PEkt'LkkXyk?g< 8 PE 
kO)y k^#^P4z^-9-±(7>^!Sy CD y k 0)SP#^ 2 0) 
frm/W — >T'gSti>o (# p e - k) flft P ET?ft 
^iJIZd i = d i -Lk2 x y k£?r5 ( i = k. #p 
e) o 

[0 0 6 9] g&lz. L55X y 5 = d 5^Sl>T. y5 
[0 0 7 0] ^C, 2OOx2OO0^J55^Pt^ 

f «. -Jnyot&z 1 otfiSt^o 

•Cli^:a5-e2 0^n^^7 x 2 O^P^^Ofr^Jt^oT 

[007 1] ca>fif?J££-PEI::i£gt-£<t, ^a-b^ 
-9-a^5-efe^<D-c, «-PE*<S^-r^gp^[i^n^ 
2O^P7^-r5O)4^n'v^05iJ«!:?5:§o ^*ib0)^ 
P^^J. 115 (A) Iz^-Tcfc-Jlw, PElA>t>IHlC 
^P'V^L ■Jay J !?2, ^p»v^3. — , -?n^2 

oin e 

[0072] jtwi::tMr**fT*-«»#"*#p eicis» 

\zm i )tt\+Ztztb\z. 115 (A) dS^x— *E« 

B15 (B) \Ztt£5\~&^WkZ-&o CCTftt. 

Wn^$?p*;> • 1M£ 'J (block c 
yd i c) lz&^Wkz_Tl^Z>o C0>3fc^ftiL"Cli. 0S 
xfi^Q^^2, 6. 10. 14, 1 80&&&m&fiz 

[0073] t^si^es, §15 (b) iz^-r^^ 

ic, pe 1 (DfrMtt^av^ 1 . 6. 11. 1 60)3£i; 
fcttVI. feLTP E 2fi^P^^ 2, 7. 1 2, 1 7, P 
E3lt^P7^3, 8. 13. 18. PE4lf?ay9 

4. 9. 14. 19. PE5li^P7^5, 1 O. 1 

5, 20<t£5o 



[007 4] gfcll::, ^P^^IjLU^jgt^o ^P 

•^1 (Hi6©bi)tt. pe 1 firt-ettKT*. -B 
i £&PE<D^ft£tt«?-911iCaHff&7K 

f. #PEia(l6J:tf»2©9->«[W»0 D PE 
KDll^-^SaSWI 1. 129- $««£W1 
2, P E 2 0>Sb 1 *7 — ^®S$W2 1 , S2 9-^ffl« 
SW2 2, PE30S1 9— £«tt£W3 1. 129- 
£«IiS*£W3 2, P E4<7>m 1 9— ^^$-W4 1 , ffi 
2 9-^«*SW4 2, PE 5 0)f 1 9— >ffl«SW5 

1. g29-^®^W52<tn o 

[0 O 7 5] 11 6 \Z/ \ v TXf-QTik LtzZfU V +> b 1 
£C1~C3l::3S?#Lf;:ii^£#*£o Z<D$M<DH 
nt<^T^tzUh>\i. C1£PE1(DW1 1-v, C2£ 
PE2fl)W2 1^, C3JPE30)W3 l^fil^K 

atr*. »=. t©«*s«oT; wi 1 (CD o>7 

-^SPE40W41^ W2 1 (C2) 0)7 — ££P 

e 5 o)W5 i ^aMME3i-rs. 

[oo7 e] frmm<Dtinx'\t, so&ics-PEomio) 

9— ^fil* (W1 1 , W2 1 , W3 1 . W4 1 , W5 
1) lc*M**ifcc I *ttoTttK*fr5. H1 71=5^ 

-r/wT>y»»^**oi=:w-jt-r*»»-efc*. PE1 

fCfclvCC 1 x R 1 OfraMd*. PE2lCfcU-CC2x 
R2CD^T^Jjg*<. PE3fCfcLNTC3 x R30)ff^JS 
PE4lCfc^tC1 xR40^Ji^, PE5lCfc 

utc2xR5 o)fmm#**i**iftw = 1 icfc 

[00 7 7] Ctt&CDtHtiW*!-*— 9^^LT 
W1 1 A^bW2 2^. W2 1 ^bW3 2^. W3 1 fr£> 
W4 2^, W4 1^bW5 2^. ffi^JlC-x— ^^jzl^fT 
dtttlC, PE1^tS^D'^b10C3$W 

1 2kue2M-*. 

[0 0 7 8] ^C, &PEa)g20)9- (W 1 

2, W22, W32, W42. W52) iCj&Sft Stlfc C 

*icttff-T4Sp»-e&*o P E 1 Iwfcl^T C 3 x R 1 0) 
frHBft*. P E 2lzfci\rc 1 x r 2 0>Tr5\mtf, PE 
3fCfcLNTC2xR30)f7^jaA<. PE4l:feUTC3 
x R 4 0)fr?IJSia<. P E SfCfclNTC 1 x R50)fr5IJa 

[0079] z.tibtotmbmmzTt—'t-'zvyLx 

W12^bW2 1^, W2 2^bW3 1 -«s W3 2^b 
W4 1-N, W4 23^bW5 1^, StMI-7— ££2l£fT 
5 PE1^S}|n^P7^bia)C2jW 
i i ic&iH-f £o 

[0 0 8 0] 3ls3§OtfS"eli. &PEO)g1039-^ 
Mm (WI 1 . W2 1 . W3 1 . W4 1 . W5 1 ) left 

**»5hMMW-*»#-cfc*. PEiizfeurc2x 

R10>f7$Ja*<. PE2l:fehtC3xR20)Wia 



t$ffi¥-7 -2 7 1 7 6 O 



tf, PE3Cfc^tC1 XR3(D*7WK#. PE4l"fc 
UNT C 2 x R 4 (Dfr^JIt^. P E 5 (Cfcl^T C 3 x R 5 

[O O 8 1 ] 01 5 (B) IZ^-r^P^/^ 2 (I2O0 
b2) (cgit-^LU^ir^-r^fr^JSajftSlli. B 
2 0 (A) l3^PE2<B/\*;/^^#£LU#<8 
L. Vcm^&mtSi&mztuytb 1 irPIC^lzc 1 
~C3l=-3«»b-ClHl^frS£:l=J:-yfT3.- * " 

[0082] 120 (B) l£:7P-/^ b 2 <t«-P ECDfc 
S5fc^^^9-^fliO)Si^to C1£PE2<DW 
21^, C2$PE3(DW3 1^, C3SPE40W4 

l^^tt^&^-r^o Sfci::^CD$£S£teoT. W2 1 
(CD a)f-^^PE50W5 1 W3 1 (C2) 

[0083] X\Z, §PE0I1O)9-^S^ (W1 
1, W2 1, W31, W4 1, W5 1) iZfe&lZlxtzC 

^lilttg-r^SP^T'fe^o PE1l:fet>tC2xR1(D 
^JSA<, PE2fCfcl>TC 1 x RZOft&mtf. PE 
3|Zfcl*TC2 x R3CDfx*)Jlt#. PE4fZfcl\TC3 
xR40^j8^, PE5!CfctN"CC 1 x R5 0)?fjim 

[0 0 8 4] Z4xt>COl+g:^^B#(wW2 1 ^bW3 2 
^, W3 1^bW4 2^, W4 1^bW5 2^, W5 1 
^bW1 2^^JI^T ? -^S3l*fT : 5i:<i:tlc f P E 2 
^«}*-r^^P^<7 b 2 CDC 3 £W2 2lcH2l"r^o 

[00 8 5] HI 8fc£l/01 Q^^lNTltt^L 

b 2l::o^T<0fma^T^£<t:, Si 5 (B) IC 
^•T^P^^3 (I220)b3) icg-r^Lu^tst 

fc-f&fj&m&ftm'rTOo S22 (a) iz^-t^pv 

^b3$LU^SLf-fc(b, 122 (B) 1= 
^P7^b3jC1-C3|C3?»L, #PE07-^ 
««^<DlsaSfT5. fit, ^P^^b3lzBILr 

0 1 7£l^L01 srittBJL^CD^^lcttSIctG 
2t£frl\ JilT. ^P->^4. 5. 2 0*TI^fillC 

iILtLU»g^7n o 
[0 0 8 6] ±TO^P^^IZO^TLU»S*fTotz 
m^S^LT, if-f ^ U '^^IC^^fc^P^ 
^^CD&tflzM-f o 02 3li, 0151^^-^5.1^^ 

t-0S£5*LTl^o 0JxJi:?P^$ 2 f 6. 1 O, 1 
4 t 1 SfC^l-r^^, 02 3 (A) fr£ (B) ^<Dg 

[0 0 8 7] *ir^fS)iz^HLrs©Lr^tcta>* 
ftA^fr^o 02 4I£. ^P^^<b*+Lfcfr^J<0»ft^ 

p^^*rsia>gs^p^^i^a ir, a^je^-ea^ 

PE 10)A5| JPE501 £>f§i3 



P^(7>M'<g|*.[z c J;y, IEetf2bbofc<t Z*-e f Ifi 

[OO88] 025li, ft^lSK^Sl^+ifcfT^J^SP 
E(7)S«$-^-r o h;U£*tf>&*:#>(&b1, b2, b 

3,.b4, b5 l*#PEt?»SLTS£N-* 0 f+JT* W L 
t=ftjSx*#PE*<»x^ >;u*f#oc 

[008 9] (1) LHX1 =b1 SPE1t'S< 6 

(2) x1 £b1 (0^l3*i6T, &PE^St5, 
bl =x1 

(3) i>1«PEifbj =bj -Ljixxl £ff 

[009 0] (4) ^ICPE2T' ( L22X2 =b2 
UTx2 

(5) x 2 *&PE^U&.~f*>o b2 =x 2 

(6) i >2tt«PE I -Cbi »bi -Li2X x2 *tt 

[009 1] KIT, W»rc|»yiKLTttaftA*»T-*- 
£«> H?TiIftA<Dfc<t, ^jI^A^^|C^5o 
[0 0 9 2] 

CD T-$<n&^&^£mmz?To^tiz£ y, ^jic 

<5„ URglz, ^P^>>^bL^^SMa)^rOxa?;^^$ 
^i^^ h;U*fSllCi£jlf|^ii|LTftff Lfcig^roHatt 

[0093] C^IZ^LT, *>J 

fty, fO)i^ii:Lfc(!:*, i§g(D:?P^*< 
mod (1-1. #pe) + 1 SgCO^P-lr^-tl- (#p 
ett^P-bv-S-Bt) l=iiy«l*6*i**3lcE«Lfc» 
^IC|£, XfTttffilt. /\-K»)i7ttll09||-Bi5 

[0094]© frMff <Dtf »0>tt)ra&rcH LTIi. 
frMa»»0)t«H=«»*T-*t#llLT. 1*21 -ft 

cco^si^^JicfTdx^rc^y. «x(^2^*^ic 

>-CS3|-r-&«^LOG 2 (#pe) IC 



(9) 



7-271760 



gfc£#d i v h-f&t, 1 + (LOG 2 (#p e/#d 
i v) /#d i v) (D^-^lCTSry, B2lS(iO. 5& 

[009 5]® g^lzMat/^iiftA^CCO* 

[H1] **9B0)HaKWHt?fc*. 

[02] ^M0)Mk«lcff«^%U5MlkBttMltini 

<D#l£^'3~0"efc<5o 

[03] H2ic^-r^p-b',yy-a)<HBR**"ria-efc*. 
[is] *«(Ho>««rcfei+*^p^*a)iEa«tw 
*t£»J a><59 * 7frt 0 t» fc £ o 

[07] MM0>lllKfllcJ3ft«fT9tSa)ttl(«IRn-r 
£0-Cr&£ e 

[08] PEii^ff^jc^feofca^a>K^i«^*r0 



[09] x-^^eattffwaflottJtaxna^n-** 
[01 o] T-^^Gs^fT^jaott^cofiis^p-^ 

^0-Cfe^o 

[011] mm/&m*tAmmmom*&7Lo>m£7K'? 

0Tfc^ o 

[01 2] «ras/*f«ftA*3iB*a>it^ifcjt*Hwr* 
0-efe^o 

[013] ttat/fltSKftAaa^Ott^ttiLOAS^n 
[01 4] f!5t/^atftA«iS^lftBj-r^0T*fc^o 

[015] *ftHa>BBtt<Di»iB-c&«. 

[0 1 6] **BJ(D3iffl«CDKK0-efc*o 

[017] **B-aa)®ffiC9<DiftBj0r*fc^)o 
[018] *«Ha>Bfflfll®HRB-c*&«. 
[019] **B^(Daffl«<DKSii-efcSo 
[020] ^^(DSfflfflicoiftwa-efc^o 
[02 1] *«B^a>iSffl«a)K^ia-cfc*o 

[02 2] **l3O>affl«(DKW0-Cfc^o 
[02 3] *ft«<&af8ffl0)K91Brfc*. 

[024] Mno)infl(DKnB-e»«. 
[025] MniDiRfloisnB-cfti. 
[026] ^Pti^fcLfc^aaoLuiMBaoKWH 

1 ^UJHftBttMtfJUl 

2 -r— ^ IltjaifS 

3 LU#J!ia«R 

4 ttX/ttSftAAB^R 



[02] 



[06] 



10 

JL 



13- 



fS 



£Btt 



rrr 



**k* -v-12 



JI4 
13 



PE#1 



12 



PE #2 



14- 



13- 



±Ett 











! 
i 








R 


i 
t 

i 




0 




u 


I 
i 

i 

v i 
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(10) 
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eg 



PE1 



PE2 



PE3 



PE4 



R1 R2 RS R4 








Pt 1 i PE2 i PE 3 

1 1 1 


PE4 






I 1 1 
1 1 
1 1 




PE1 








1 1 

t 1 




PE2 








1 i 

1 1 




PE3 








1 1 




PE4 






1 « 







[05] 

PEl PE2 PES P E 4 



1 


2 


3 


4 











5 


6 


7 


8 











9 


10 


11 


12 











13 


14 


15 


16 












103 K=l 
2BB K=2 

K = 4 



K-2 
K=3 
K-4 
K=1 



K=3 
K=4 
K=1 
K=2 



K = 4 

K = 2 
K = 3 



| mod (ttb, ffpe) =D(OtA n 1 = 1 | 



[H3] 




(11) 



-2 7 1 7 6 0 



CH4] 



II 2] 



C n £ ) 
1 



c o u n t = 0 

mod <n 1 ##b, #p e) =0 



1 



§PEfk=1+ (pno-1)/n1 <tT* 
(P noliPES^) 



S2 



A,, 


1 Ai,g 


Ai. 


r— ■ 
A M 


A,. 


A,i 


A« 


| A«»| 


A .4 


A„ 


A a , 


A,. 


A« a 




A» 


A«t 


A«. 


A*. 


I A«4 


i A 4 , 1 




... 


Am 


| Am 


A M 



S7 



«pET?*«>if-iF*r*. 

p= (pno-1) *#b + k 
P 1 = (P-1) /#P e 
P 2 =m o d (p - 1 , #p e) 
q«P 2*#b + p 1 +1 



S3 



S 4 




k = k+ 1 

k = mo d (k-1, #b> + 1 
1 



IM2 5] 















PE1 








Um 


U.t 



PE2 













Lti 




U» 








L«\ 





















PES 


La. 


L« 




U.4 





PE4 


L«i 


L 4 . 


L 4a 


L 4 /\ 
















PES 


Lai 


L 5 , 


Lu 


L M 


L.X 



b 4 



PE1 PE2 PES PE4 PE5 
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[B8] 

p e i co***fcia*<8eaH 




n 1] 




(B) 

frWB 



l®1 3] 



(ate) 



S^afc^t*- (1~#pe) r- 
J=k, #c t = 1 



-S4 1 



&mz&7u-£vVZ'B j k = A j kfcff? 



-S4 2 



k = mo d (k, #.p e> + 1 
#c t=#e t + 1 



-S4 3 
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[193 



p=mod <k-1f #pe> 




S2 1 



0 i CI = 1 ■ • 


n) 5 




■faizyV-m o d 


(P+ i -2, #P a> + 1 <*> 


W 1 icftm? * 






$8 = 0 







-S2 1 



$ n = N*2 $ e 
$t=min ($n, #P9 — $n) 



>S2 2 



3=mod (p+J-2, #pe) +1 
d=mod (p + $t + J-2i #pe) +1 

Zf □ -fe s i% £» y □ -fe v -y - d lc 

j = i • • $ t <d $ t ®£M?nctE2rr-5 



-S2 3 




[Si 4] 



ffSIB 



PE1 














y 1 








PE2 


L„ 












y 2 




d2 




PES 


Lai 


L„ 


V 








y 3 




d3 




PE4 


U, 
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